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f^*) . Abstract. We give a new lower bound on the expansion coefR- 

O^l ' cient of an edge- vertex graph of a d-regular graph. As a conse- 

pH . quence, we obtain an improvement on the lower bound on relative 

^ ' minimum distance of the expander codes constructed by Sipser and 

Spielman. We also derive some improved results on the vertex ex- 

lO ' pansion of graphs that help us in improving the parameters of the 

Cn , expander codes of Alon, Bruck, Naor, Naor, and Roth. 
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I. Introduction 

The notions of expanders, magnifiers and concentrators were intro- 
duced by Bassalygo and Pinsker [4 , and Pippeneger P^ in 1970s in 
the study of communication networks (in particular switching circuits). 
The areas of apphcations of expander graphs in general have grown 
vastly. To quote F.T. Leighton f^: "Expander graphs will become basic 
building blocks for the future high performance computing" . Expander 
graphs were used by Ajtai, Komlos and Szemeredi in constructing an 
0(nlogn) sorting network on sequential machines and a clogn sorting 
network on parallel machines (see ^H] for references). They have huge 
number of applications in Computer Science, in Communication Sci- 
ences, and in Mathematics; we refer to Leighton and Maggs [lOj and 
Janwa and Rangachari |H| for details. 

In coding theory applications of expander graphs go back to the work 
of Tanner in the analysis and algebraic synthesis of the low density 
parity check codes introduced by R.G. Gallager 0. Recently Sipser 
and Spielman [1^] constructed "Expander Codes" based on expander 
graphs. They also gave a fast decoding algorithm. Spielman ^7] fur- 
ther showed that a class of expander codes can be encoded and decoded 
in linear time. Subsequent work by other researchers have shown that 
one can use these ideas to construct codes that give performance near 
Shannon capacity!! Thus they show performance better than the fa- 
mous turbo codes. Many recent researches address this question (see 
for example 0). 

Expander graphs also form a basis of the work by Alon et al. ^ in 
construction of their expander codes which asymptotically attain the 
Blokh-Zyablov bound. 

The outline of the paper is as follows. Since the construction of Sipser 
and Spielman relies heavily on the edge-vertex graphs, we derive a new 
lower bound on the expansion coefficient of the edge-vertex graph of 
a (i- regular graph (in Section II, Theorem 12. 2j) . In Section III, we use 
this bound to give an improvement on the lower bound on relative 
minimum distance of the expander codes (Theorem 13. 3|) constructed 
by Sipser and Spielman ^^. We show that this lower bound is in fact 
better, sometimes, by a factor of 3 (see Remark l3.6|) . In Section IV, 
we derive some results concerning the expander codes constructed by 
Alon et al. [2]. We first derive an improvement ( Lemma l4.5|) on the 
lower bound on \dS\ (defined below) of Alon et al. ^2j. This helps us in 
obtaining an improved bound (Corollarv l4.3p on the minimum distance 
of the expander codes of Alon et al. 
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LA. Expander Graphs. Let G = (V, E) be a graph on n vertices 
with adjacency matrix A. The matrix A is a real symmetric matrix 
and has n real eigenvalues, say, Aq > Ai > ■ ■ ■ > A„_i. Then define 

fi{G) = max{Ai, |A„_i|}. 

Throughout this paper fi will be used in place of /x(G) if the graph 
G is understood from the context. 

Let G = {V, E) be a graph. Then for any vertex v e V, we define 
dv = {u eV : {u, v) G E}, and for any subset S of the vertex set. 



;i) 9S=\J dv. 



Note that for any subset S of the vertex set V, OS can also be defined 
a.sdS = {ueV -.Sndu^^. 

Let d*v = dv\ {v} and d*S = [j d*v (= dS\S). 

ves 

Remark 1.1. Observe that for a bipartite graph d*S = dS. Note that 
if d{v, S) denotes the distance of the vertex v E V from S G V, then 

d*S = {veV ■.d{v,S) = l}, 

i.e., d*S is the boundary of S. 

Definition 1.1 (Expansion Coefficient). For a > 0, the expansion 
coefficient, denoted c(a), of a graph G = (V, E) is defined as 

c{a) = min l^-^ : S CV, < \S\ < a\V\ 

Definition 1.2 ((n, c, d, e, (5)-Expanders) . A (c, d) — regular bipartite graph 
G = {V, E) is called an (n, c, d, e, 5) — expander if it is a graph on n in- 
put vertices /, in which every subset of at most en vertices of I expands 
by a factor of at least 5, i.e., 

yScI, with\S\<en, \d*S\>6\S\. 

Remark 1.2. The above two definitions were motivated in the litera- 
ture by the concept of a bounded strong concentrator defined by Gabber 
and Gain [B]. 

Theorem 1.1 (Tanner JH]). A {c,d)— regular graph G on n vertices is 
an expander graph with parameters {n,c,d,a,c{a)) and the expansion 
coefficient 

~ [acd + /i^(l — a)] 



H. L. JANWA 



AND A. K. LAL 



II. A Bound on the Expansion Coefficient of Edge- Vertex 

Graphs 

Let G be a rf— regular graph on n vertices with M as its edge-vertex 
incidence matrix. Then the edge-vertex graph of G, denoted 7i, is a 
graph with adjacency matrix, 



A{n) 



M 
M* 



dn 



The edge-vertex graph is a bipartite graph with - — input vertices, 

each of degree 2, and n output vertices, each of degree d. If A{G) is the 
adjacency matrix of the graph G then using the fact that the non-zero 
eigenvalues of MM* and M*M are same, we have the following lemma. 

Lemma 2.1. Let G be a d— regular graph on n vertices with M as its 
edge-vertex incidence matrix. Then M*M = A{G) + dl and 

Ao(H) = V2d and fi{H) = ^d + ^i{G). 

Hence, we use Theorem II. II to conclude the following. 

Proposition 2.1. Let G he a d— regular graph on n vertices. Then the 
edge-vertex graph Ti is an (rarf/2, 2, d, a, c(a)) expander graph with 



and 
(3) 



Ao(7^) = V2d and fi{n) = ^/d + 12(G), 

c(a) > —n ^ — n r- 

^ ^ ~ a(d - /i) + ((i + /i) 



We give an improvement on the bound in Q using the following 
result of Alon and Chung j3] . 

Lemma 2.2 (Alon and Chung^). Let G he a d— regular graph on n 
vertices. Let S he a suhset of the vertex set of G with \S\ = 771. Then, 
for e{S), the numher of edges contained in the subgraph induced hy S 
in G, 



(4) 



e{S) — - d •y'^ n 



1 , 



Remark 2.3. Observe that in Lemma iS.^ we can replace fi by Ai and 
A„_i to get a better bound on e{S), given by 

11 11 

-d-f^n + -A„_i7(l - 7)n < e{S) < - d -f^ n + -Ai7(l - 7)71. 
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Remark 2.4. Observe that Lemma 



m,eans that if we have 



dn 



/i 



e(^) > 2 ^ ^ ^ ^ 2^'^^^ - 7)^ = Y [7 + ^7(1 - 7) 
then the corresponding subset S of V will have \S\ > '-/n, since 



dn 
~2 



7^ H — 7(1 — 7) is a decreasing function of 'j. 
d J 



Theorem 2.2. Let G = {V{G), E[G)) be a d— regular graph on n ver- 
tices. LetTi be the corresponding {nd/2,2,d,a,c{a)) expander graph. 
Then 

(5) 



cia) > 



fi + sj iJ? + 4a;((i — [i)d 



Proof Let V{n) = I{n) U 0(H), where liH) represents the set of 
input vertices and 0(H) represents the set of output vertices of the 
graph H. 

For any subset S of V{G), an edge {u, v) G e{S) if and only if {u, v) e 
E{G) with u,v & S. This is equivalent to saying that {u,v) e e(5') if 
and only if there exists a vertex r G I(Ti.) such that (r, u), (r, t>) G EiH) 
with u,v E S C OiTi). Therefore, 

\e{S)\ = \{t G I{n) : (r,M), {t,v) G E{n), u,v e S C 0{n)}\. 

dfi 
Now let T C /(7i) with |T| = a\I{7i)\ = a — . Then corresponding to 

this subset T of Kji), we will get a set 5* of V{G) such that T C e{S) 
and (9T = S". Suppose a = 7^ + ^7(1 — 7) and T C /(7i) with \T\ = 



dn 



72 + ^7(1-7)] . Then \e{S)\ > 



dn 



d 



Remark 

\dT\ > 7n 

(6) 



7' + ^7(1 - 7) 
implies 



and thus 
that 



7((i - n) + iJ, 

c(a) > 



T\. Hence, 



7(d-/i) + /i' 

The lower bound on c{a) can be expressed as a function of a using the 
following equalities: 

« = 7 +^7(1-7) 
<^==^ (d — /i)7^ + yU7 — arf = 



/i 



<^=^ {d - fi)^ + jj, = - + -^/jj,"^ + Aad{d- fi). 
The lower bound of c{a) in © now follows from ©• 
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Remark 2.5. We note that any {nd/2, 2, d, a, c{a)) expander graph, H, 
can be interpreted as an edge-vertex graph of a graph G in an obvious 
manner. 

Corollary 2.1. The bound on c{a) obtained for an {nd/2, 2, d, a, c{a)) 
expander graph in Theorem \2.^ is better than the one derived in Propo- 
sition Wl\ 

Proof. It is enough to show that 

4 



< 



a((i - /i) + rf + /i /i + A//i2 + Aad{d - /i) 



<^=^ a{d — fi) + d + jj > jj, + y jj? + Aad{d — jj) 
<^^ [d - a{d - fi)]'^ > jj,"^ 
<J=^ (d- fi){l - a) > 
which is always true since 1 > a and d > fi. ■ 

Corollary 2.2. Let G be a d— regular graph on n vertices and let 

de > fi. Then the corresponding edge-vertex expander graph {nd/2, 2, d, a^, c{ao)), 

with ao = e{de — fi)/{d — /i) has 

c(ao) > -r- 
de 

Proof. Using Theorem 12.21 we know that 

4 



(7) c(ao) > J 

y" + V Ai^ + 4Q;o((i - \i)d 

Now replacing a^id — /i) in the denominator by t{dt — /i) in ((7j) we get 
the required result. ■ 

Corollary 12.21 is used in the next section to give an improved bound 
on the minimum distance of some expander codes of Sipser and Spiel- 
man [T^ . 

111. Improved Bounds on the Parameters of 
Some Expander Codes 

Definition 3.3 (Expander codes, Sipser and Spielman). Let G be a 

(c, d) — regular bipartite graph between a set ofn input vertices {vi, V2, ■ ■ ■ , f„}, 

TtC 

called variables, and a set of —- output vertices {Ci, C2, . . . , C„d/2}, 

d 
called constraints. Let b{i,j) be a function designed so that, for each 

constraint Q, the variables neighbouring Q are f6(i,i), . . . ,f6(i,d)- Let 

C be an error correcting code of block length d. The expander code 

C{G, G) is the code of block length n whose codewords are the words 
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{xi,X2, ■ ■ ■ ,Xn) such that for 1 < i < nc/d, {xb(i^i), . . . ,Xb(^i^d)) is a 
codeword ofC. 

Lemma 3.3 (Sipser and Spielman ^1]). Let G be an {n,c,d,a,c/de) 
expander graph and C be an [d,rd,ed] linear code. Then the expander 
code C{G, C) has rate at least cr — (c— 1) and minimum relative distance 
at least a. 

We now give an improvement to a result of Sipser and Spielman |161 
Lemma 15] on the minimum distance of expander codes. This is be- 
cause we are able to derive a new lower bound on the expansion coef- 
ficient of an edge- vertex graph 7i of a rf— regular graph G (cf. Theo- 
rem EH)). This also helps in concluding that d— regular good expander 
graphs that are not bipartite also lead to good-expander codes (via the 
edge- vertex graphs). 

Theorem 3.3. Let G be a d— regular graph on n vertices and edge- 
vertex graph Ti with de > fi. Also, let C be an [c?, rrf, ed] linear code. 
Then the expander code C(H, C) has rate at least 2r — 1 and minimum 

relative distance at least 

e{de — fj,) 

d — n 

Proof. Corollary 12.21 implies that the edge-vertex graph Ti is an 

nd eide — ii) 2 , tt t rr-m- i- i 

( — , 2, a, — ; , --) expander graph. Hence Lemma 13 . 31 implies the 

2 d — ^ de 

required result. ■ 

Remark 3.6. Observe that our bound on the minimum relative dis- 

tance of the expander code is better than the bound — ; obtained 

L d — jji 

by Sipser and Spielman \1%^ Lemma 15] . We achieve an improvement 

by a factor of 

(8) 1 + ^. 

[de — jj,) 

As a concrete example, we consider the infinite sequence {Gj}^! of 
(g-|-l)— regular Ramanujan graphs constructed by Morgenstern jT^j (his 
work was inspired by the work of Lubotzky, Phillips and Sarnak jTT] 
and that of Margulis IT^). Let us choose q = 2^"^ for some m and 

e ~ —^ —; then fi{Gi) ~ 2™+^ for every i = 1, 2, . . . , oo. For the 

initial code, we choose a binary subfield subcode of the extended Reed- 
Solomon code of length 2^™ + 1 with the minimum distance at least 
e(2^™ + 1). Then dH} implies that we get an improvement by a factor 
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of 3 on the relative minimum distance of the infinite sequence of codes 
{C(G„C)}-,. 

IV. Improved Bounds on the Minimum Distance of 
Expander Codes Introduced by Alon et al. 

We now give an improved bound on the relative distance of the 
expander codes defined by Alon et al. |2]. 

Lemma 4.4. Let G = {V, E) he a d— regular graph on n vertices. Then, 
for all subsets S of V with \S\ = an, 

(9) ^|5nai;p< [a(rf2-^2)+^2j |^|_ 

Proof. Let {0j}"=i be the orthonormal set of eigenvectors of the real 
symmetric adjacency matrix A of the graph G, with corresponding 
eigenvalues Aq > Ai = /i > A2 > ■ ■ ■ > A„_i. Then by Perron- Frobenius 
theorem, the largest eigenvalue oi A is Xq = d with the corresponding 
eigenvector (pQ = {1,1, . . . , Vf j ^fn. 

n-\ 

Let f = fs^G the characteristic vector of the set S. Let f = Yl li4>i- 



Then, 70 = (/, (pi) = a^, and 



i=0 



n-l 



Y.\S^dv\- = {Af,Af) = Y,XH 
= 7o'(A^-A?) + A?(/,/) 

2/72 2\ 2 

= a n[a ~ fi ) + fi an 
= [a{d^ - fi^) + fi^]\S\. 



Lemma f4.4l helps us prove the following lower bound on dS, for S C 
V. 

Lemma 4.5. Let G = {V, E) be a d— regular graph on n vertices. Let 
S C V with \S\ = an. Then 

(10) \dS\ > "^'l^' 



and 

(11) \dS\ = \{v e V : S n dv = (l}}\ < ^ l"^' 



[a{d'^ - jj"^) +/i2]' 
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Proof. It can be seen that ^ |S'n9t'| = d\S\ = dan. Hence using 
Lemma 14.41 and the Cauchy-Schwartz inequahty, we get 

,2 2 2 I E \sndv\) 

-^ = ^'''' |gg| ^ <J2\Sndv\^< [a{d^ - i^^) + ^^]an. 



Thus, 



,^„, d'^an d'^\S\ 

\dS\ > 



[a{d^ - 12^) + 12^] [a{d^ - 12^) + fi^y 

The bound in pi|) on \dS\ follows by observing that \dS\ = n — \dS\. 
■ 

Lemma 14.51 gives a better bound on OS as compared to the bound 

— ^^^\s\ 

obtained by Alon et al. 0] which is dS < — —. Therefore, we obtain 

ad^ 
a stronger bound on the minimum weight of expander codes of Alon et 

al. as compared to the bound obtained by them in 0. The definition 

of their expander codes follows. 

Definition 4.4 (Expander Codes, Alon et al. ^). Let G be a d— regular 
expander graph on n vertices. Let C he an [tt,, fc, S^n] code over ¥q. Then 
Alon et al. use G to define an expander code Cexp over F^d as follows: 
Label the vertices of G by 1,2, ... ,n. For each vertex i {1 < i < n), let 
li{i), hi'i), • • • 5 hii) denote the d vertices that are adjacent to i, indexed 
according to some prespecified order. 

The expander map (pexp '■ ^q — ^ ^^d is defined as follows: 
[ai,a2,...,an] — > [ai, ^2, . . . , a„], whereat = [ai,(i), a;2(i), . . . , ai^(i)] 
(by identifying ¥qd and F^). 

The expander code Cexp is defined to be 4>exp{C). 

Remark 4.7. It was observed by Alon et al. that 

: i) the expander code Cexp ^^o,y ^o longer be a linear code. 
: ii) the Hamming distance between any two codewords C\,C2 G 
Cexp equals the Hamming weight of ci — €2- 

Remark 4.8. We further observe that 

: i) the expander code Cexp is ¥q— linear. 

: ii) the ¥g image of Cexp is a special permutation of the 
d— repetition of the original code C. 

Theorem 4.4. Let G be a d— regular graph on n vertices and let G 
be an [n,rQn,5Qn\ code over F^. Then Cexp is a code of length n, rate 
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(—r)n over¥„d with minimum distance at least 

d? 5q n 



5o(c^2-/i2)+/i2- 



Proof. Let S = supp (m) for any codeword u = [ai, 02, . . . , ctn] G C 
with wt(M) = Squ. Let U G Cexp be the corresponding codeword. Then 
i G supp (U) if and only if there exists j, I < j < d such that a^^(i) 7^ 0. 
That is, if and only if d{i} fl S* 7^ 0. Hence supp (f/) = dS. Therefore 
the result follows by using Lemma f4. 51 and Remark 14. 71 ■ 

Corollary 4.3. Let G be a A— regular Ramanujan graph on n vertices 
and let C be as in Theorem \4-4\ Then Cexp has minimum distance at 
least 

A 60 n 

6oA + A{l-6o)- 
Proof. Using Theorem 14.41 we derive that the minimum distance of 

/\ 2 X „ 

CexD is at least ^ . . ^ -. But for Ramanujan graphs u^ < 

4(A — 1) < 4A. Hence the result follows by replacing /x^ by 4A. ■ 

Remark 4.9. Our bound on the minimum distance of Cexp is greater 
than 

Ml^l^^^Mr, the one ,^.en ty Alan et al Lemma 1]. 



Acknowledgements: The second author would like to thank the De- 
partment of Mathematics and Computer Science, University of Puerto 
Rico, Rio Piedras Campus, San Juan, for their hospitality and a visit- 
ing appointment during August 2000 to July 2001, when the work was 
done. 

References 

[1] N. Alon, "Eigenvalues and expanders," Combinatorica, 6 (1986), 83-96. 

[2] N. Alon, J. Bruck, J. Naor, M. Naor, and R. M. Roth, "Construction of asymp- 
totically good low-rate error-correcting codes through pseudo-random graphs," 
IEEE Trans. Inform. Theory, vol. 38, no. 2, pp. 509-516, Mar. 1992. 

[3] N. Alon and F. R. K. Chung, "Explicit construction of linear sized tolerant 
networks," Discr. Math., vol. 72, pp.15-19, 1988. 

[4] L. A. Bassalygo and M. S. Pinsker, "Complexity of an optimum non-blocking 
switching network with reconncctions, Problemy Informatsii, 9 (1973), pp. 84- 
87, English translation in Problems of Information Transmission, Plenum, New 
York, 1975. 



ON EXPANDER GRAPHS 11 

[5] Proceedings of the 1999 IMA Summer Workshop on Codes, Systems, and 

Graphical Models, ed. Brian Marcus and Joachim RosenthaL 
[6] O. Gabber and Z. Gahl, "Explicit construction of liner size superconcentra- 
tors," Proc. 20th Annual IEEE Symposium on Foundations of Computer Sci- 
ence, 29-31 Oct. 1979, San Juan, PR, pp. 364-370. 
[7] Gallager, R. G., Low Density Parity Check Codes, Monograph, M.I.T. Press, 

1963. 
[8] H. L. Janwa and S.S. Rangachari, Ramanujan Graphs and Their Applications, 

Monograph, to appear. 
[9] F. Thomson Leighton, Introduction to parallel algorithms and architectures. 
Arrays, trees, hypercubes, Morgan Kaufmann, San Mateo, CA, 1992. xx+831 
pp. ISBN: 1-55860-117-1 

[10] F. Thomson Leighton and Bruce Maggs, Introduction to Parallel Al- 
gorithms AND Architectures: Expanders • PRAMS • VLSI. Morgan 
and Kaufmann, Pub.. San Mateo, California. To appear. 

[11] A. Lubotzky, R. Phillips, and P. Sarnak, "Ramanujan graphs," Combinatorica, 
vol. 8, no. 3, pp. 261 - 277, 1988. 

[12] G. A. Margulis, "Explicit group theoretical constructions of combinatorial 
schemes and their application to design of expanders and concentrators," 
Probl. Inform. Transm., vol. 24, no. 1, pp. 39-46, July 1988. 

[13] M. Morgenstern, "Existence and explicit constructions of {q + 1)— regular Ra- 
manujan graphs for every prime power q," J. Comb. Theory, Ser. B, vol. 62, 
pp. 44 - 62, 1994. 

[14] N. Pippeneger, "Superconcentrators," SIAM J. Comput. 6 (1977), pp. 298-304. 

[15] Peter Sarnak, Some Applications of Modular Forms. Cambridge University 
Press, 1990. 

[16] M. Sipser and D. A. Spielman, "Expander Codes," IEEE Trans. Inform. The- 
ory, vol. 42, no. 6, pp. 1710-1722, Nov. 1996. 

[17] D.A. Spielman, "Linear-time encodable and decodable error-correcting codes," 
IEEE Trans. Inform. Theory, vol. 42, No. 6, pp. 1723-1731, Nov 1996. 

[18] R. M. Tanner, "Explicit concentrators from generalized n-gons," SIAM J. Alg. 
Disc. Meth., vol. 5, No. 3, pp. 287-293, Sept 1984. 

Department of Mathematics and Computer Science, University of 
Puerto Rico (UPR), Rio Piedras Campus, P.O. Box: 23355, San 
Juan, PR 00931 - 3355. 
E-mail address : h j anwaOrrpac . upr .clu.edu 

Department of Mathematics, Indian Institute of Technology Kan- 
pur, Kanpur - 208016, INDIA 
E-mail address: arlalOiitk. ac. in 



